PATH REROUTING MECHANISM UTILIZING 
MULTIPLE LINK BANDWIDTH ALLOCATIONS 



FIELD OF THE INVENTION 



The present invention relates generally to data communications and more particularly 



relates to a path rerouting mechanism utilizing multiple link bandwidth allocations for use in 
networks employing link state advertising. 



Currently, the number of data networks and the volume of traffic these networks carry 
are increasing at an ever increasing rate. The network devices making up these networks 
generally consist of specialized hardware designed to move data at very high speeds. Typical 
asynchronous packet based networks, such as Ethernet or MPLS based networks, are mainly 
comprised of end stations, hubs, switches, routers, bridges and gateways. A network 
management system (NMS) is typically employed to provision, administer and maintain the 
network. 

Multiprotocol Label Switching (MPLS) based networks are becoming increasingly 
popular especially in traffic engineering IP networks. MPLS uses a label switching model to 
switch data over a Label Switched Path (LSP). The route of an LSP is determined by the 
network layer routing function from the topology of the network and the demands of the user. 
Any suitable link state routing protocol may be used such as Open Shortest Path First (OSPF) 
or Intermediate System to Intermediate System (ISIS) routing protocol to provide the link 
state topology information needed by the network layer routing to engineer data traffic. LSPs 
may be setup using any suitable signaling protocol such as RSVP-TE or CR-LDP. 

There is increasing demand by users that the IP network include a mechanism for fast 
repair of failed links or nodes. Since a LSP traverses a fixed path in the network, its 
reliability is dependent on the links and nodes along the path. It is common for many 
networks to provide some form of protection in the event of failure. For example, in the 
event of a link or node failure, the network can be adapted to switch data traffic around the 
failed element via a protection route. 

The protection of traffic can be accomplished in several ways using the MPLS 
framework. Two ways that traffic can be protected using MPLS include recovery via LSP 
rerouting or via MPLS protection switching or rerouting actions. 



BACKGROUND OF THE INVENTION 
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The two basic models for path recovery include path rerouting and protection 
switching. Protection switching and rerouting may be used in combination. For example, 
protection switching provides a quick switchover to a recovery path for rapid restoration of 
connectivity while slower path rerouting determines a new optimal network configuration at a 
5 later time. 

In recovery by path rerouting, new paths or path segments are established on demand 
for restoring traffic after the occurrence of a fault. The new paths may be chosen based upon 
fault information, network routing policies, pre-defined configurations and network topology 
information. Thus, upon detecting a fault, paths or path segments to bypass the fault are 

10 established using the signaling protocol. Note that reroute mechanisms are inherently slower 
than protection switching mechanisms, since more processing and configuring must be done 
following the detection of a fault. The advantage of reroute mechanisms is that they are 
simpler and cheaper since no resources are committed until after the fault occurs and the 
location of the fault is detected. An additional advantage of reroute mechanisms is that the 

15 LSP paths they create are better optimized, and therefore consume less network resources. 

Note also that once the network routing algorithms have converged after a fault, it 
may be preferable, to re-optimize the network by performing a reroute based on the current 
state of the network and network policies in place. 

In contrast to path rerouting, protection switching recovery mechanisms pre-establish 

20 a recovery path or path segment, based on network routing policies and the restoration 
requirements of the traffic on the working path. Preferably, the recovery path is link and 
node disjoint with the working path. When a fault is detected, the protected traffic is 
switched over to the recovery path(s) and restored. 

The resources (i.e. bandwidth, buffers, processing, etc.) on the recovery path may be 

25 used to carry either a copy of the working path traffic or extra traffic that is displaced when a 
protection switch occurs leading to two subtypes of protection switching. In the first, known 
as 1+1 protection, the resources (bandwidth, buffers, processing capacity) on the recovery 
path are fully reserved, and carry the same traffic as the working path. Selection between the 
traffic on the working and recovery paths is made at the path merge LSR (PML). 

30 In the second, known as 1:1 protection, the resources (if any) allocated on the 

recovery path are fully available to low priority or excess mformation rate (EIR) traffic 
except when the recovery path is in use due to a fault on the working path. In other words, in 
1:1 protection, the protected traffic normally travels only on the working path, and is 
switched to the recovery path only when the working path has a fault. Once the protection 
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switch is initiated, the low priority or EIR traffic being carried on the recovery path is 
displaced by the protected traffic. This method affords a way to make efficient use of the 
recovery path resources. 

An example of protection switching in MPLS networks is described below. A 
5 diagram illustrating an example MPLS based network incorporating a bypass tunnel is shown 
in Figure 1. The network, generally referenced 10, comprises a plurality of label switched 
routers (LSRs) 12 connected by links 14. Backup tunnels are established for protecting LSPs 
statically by the management station or using RSVP signaling. RSVP extensions for up LSP 
tunnels have been defined. To meet the needs of real-time applications such as video on 

10 demand, voice over IP, etc., it is desirable to affect the repair of LSP tunnels within tens of 
milliseconds. Protection switching can provide such repair times. 

For example, LSRl creates a tunnel to LSRS via the path [LSRl, LSR2, LSRS, LSR4, 
LSR5]. LSR2 can provide a repair by creating a partial backup tunnel [LSR2, LSRS, LSR9, 
LSR4], as shown by the dashed line 16, which merges with the original tunnel [LSRl, LSR2, 

15 LSRS, LSR4, LSRS] at LSR4. For each LSP to be backed up, another backup LSP is 
established. 

The LSPs can also be protected (i.e. backed up) using the label stacking capabilities of 
MPLS. Instead of creating a separate LSP for every backed-up LSP tunnel, a single LSP is 
created which serves to backup a set of tunnels. Such a tunnel is termed a bypass tunnel. 

20 The bypass tunnel itself is established just like any other LSP tunnel. The bypass tunnel must 
intersect the original tunnel(s) somewhere downstream of the point of repair. Note that this 
implies that the set of tunnels being backed up all pass through a common downstream node. 
Candidates for this set of tunnels include all tunnels that pass through the point of local repair 
and through this common node which do not use the facilities being bypassed. 

25 To repair the backed up tunnels, packets belonging to a repaired tunnel are redirected 

onto the bypass tunnel. An additional label representing the bypass tunnel is stacked onto the 
redirected packets. At the last LSR of the bypass tunnel, the label for the bypass tunnel is 
popped off the stack, revealing the label that represents the tunnel being backed up. An 
alternative approach is to pop the bypass-tunnel label at the penultimate LSR of the bypass 

30 tunnel. 

With reference to Figure 1, LSR2 in this case would build a bypass tunnel [LSR2, 
LSRS, LSR9, LSR4] represented by the dashed line 16. The backup path for [LSRl, LSR2, 
LSRS, LSR4, LSRS] rejoins the original path at LSR4, but its path is now [LSRl, LSR2, 
LSR4, LSRS] with the bypass tunnel as the connection between LSR2 and LSR4. 
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Note that this bypass tunnel can also be a backup for tunnels from any of LSRl, 
LSR2, LSR6 or LSR8 to any of LSR4, LSR5, or LSRIO that traverse the path LSR2 to LSR3 
to LSR4 in case of a failure of the link LSR2 to LSR3 or of the node LSR3. A bypass tunnel 
for protecting the link between LSR2 and LSR3 can also be created (this tunnel should start 
5 at LSR2 and end at LSR3). 

The above describes the use of protection tunnels to quickly restore traffic after a link 
or a node failure. In some cases, the use of protection tunnels, however, does not protect 
against node failures. Due to the practice of sharing the same protection bandwidth between 
multiple protection tunnels, the case of multiple failures may result in there not being 
10 sufficient bandwidth to restore traffic on all the working LSPs that share the tunnel either by 
activating additional protection tunnels or by rerouting these LSPs. In addition, when a link 
fails, the protection tunnels traversing that link are not available to protect other links in the 
event they fail. Thus, when a node or link fails, the part of the network that has its protection 
bandwidth available for protection tunnels does not allow creation of protection mnnels for 
15 these links. This means that the next node or link that fails will not be protected. 

There is therefore a need for a protection mechanism that is capable of protecting 
working paths against failures that are not protected by a protection tunnel. Such failures 
include for example node failures and link failures that are were not originally protected by a 
protection tunnel or were originally protected but the protection tunnel is not available. 

20 
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SUMMARY OF THE INVENTION 
The present invention provides a path reroute mechanism for use in communication 
networks. The mechanism comprises a multistage search for a routing path to restore traffic 
following a failure that could not be protected by a previously established protection route 
5 (i.e. protection tunnel, bypass, etc.). The invention is applicable for use in any traffic 
engineering technique used to create connections in a network. The traffic engineering used 
must rely on some type of link state information advertising whereby the available 
bandwidths on each link is flooded throughout the network and used in making bandwidth 
calculations to insure that connections will provide previously agreed on Committed 

10 Information Rates (CIRs). 

The invention is not limited by the type of network in use, the type of routing used to 
select the reroutes or by the or signaling in use in the network. Examples of applicable 
networks include, but are not limited to, MPLS and Private Network to Network Interface 
(PNNI) based Asynchronous Transfer Mode (ATM) networks. 

15 The path reroute mechanism comprises performing multiple searches for a route when 

a LSP is to be rerouted. Each search is performed on a different type of previously allocated 
link bandwidth. In the example embodiment presented herein, three different bandwidth 
types are defined including: bandwidth reserved for protection purposes, bandwidth reserved 
for protected paths (i.e. protected LSPs, LSPs that will be rerouted to the protection tunnel 

20 upon link failure) and bandwidth reserved for unprotected paths (i.e. unprotected LSPs). 

In the event OSPF-TE is utilized in the network, only two additional TLVs need be 
defmed since the OSPF-TE definition already contains a definition of a sub-TLV reflecting 
the value of the available bandwidth on the Imk. If the OSPF-TE sub-TLV reflects the entire 
available bandwidth in the link, then only TLVs (or sub-TLVs) for protected LSPs and for 

25 unprotected LSPs are required; the bandwidth for the protection bandwidth being derived 
from them. 

Alternatively, the OSPF-TE sub-TLV may contain the bandwidth available for 
protected and unprotected LSPs. In this case two additional TLVs (or sub-TLVs) are defined, 
one for the available bandwidth of protected LSPs and one for the available bandwidth of 
30 protection tunnels. 

Other combinations are also possible. Note that if there is no need to support 
unprotected LSPs, only a single TLV need be added above the one provided by the OSPF-TE 
protocol. 
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In any case, protection-tunnels flowing through a link do not reduce the amount of 
any of these values, since these tunnels do not usually forward any traffic. 

Thus, in order for a node to be able to reroute a LSP, it must have knowledge about 
the availability of the different bandwidths on each link. This is achieved by having each 
5 node advertise the actual amount of bandwidth available on each link. Many routing 
protocols already include such a capability including, OSPF with traffic engineering 
extensions (OSPF-TE), ISIS, Border Gateway Protocol (BGP), ATM PNNI, etc. 

When needing to route or reroute an LSP, the LSP-initiating node first runs a routing 
search algorithm such as Dijkstra but only on the links in which the available bandwidth 

10 exceeds the committed information rate (CIR) requirement of user LSPs. If this first search 
did not succeed, the LSP-initiating node runs Dijkstra a second time but considering the 
bandwidth reserved for protection purposes as well as that reserved for non-protection 
purposes. If two types of user LSPs are required (i.e. protected and unprotected LSPs), a 
three step search is performed. 

15 The mechanism of the present invention has the advantage of taking into account the 

existence of multiple traffic priority classes and the overbooking factor used by nodes in 
allocating bandwidth to LSPs. In many network implementations, the LSRs maintain a 
different overbooking factor for each priority class. Further, the overbooking factor is local 
to the LSR and is not necessarily known to the LSP initiating node. 

20 The path reroute mechanism of the present invention provides several per link TLVs 

to be advertised by the routing protocol (e.g., OSPF-TE), that comprise link bandwidth 
availability information available for new LSPs in each priority class. TLVs are provided for 
the three types of available bandwidth on a link: protection bandwidth, bandwidth for 
protected LSPs and bandwidth for protected LSPs. The information is received by each node 

25 and used when a path reroute is to be performed. 

Although the invention is especially suited for implementation in software, it can also 
be implemented in hardware. In one embodiment, a network device comprising a processor, 
memory, etc. is operative to execute software adapted to perform the path rerouting 
mechanism of the present invention. 

30 There is thus provided in accordance with the present invention a method of path 

routing in a network, the method comprising the steps of receiving link state advertising 
information generated by nodes within the network, the link state advertising information 
utilized to derive the bandwidth available on a particular link for protection paths, protected 
paths and unprotected paths, performing a first search for a path using only links having 
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sufficient bandwidth available of a type the same as that of the path to be found to 
accommodate the path; if the first search is not successful then, performing a second search 
for a path using only links having sufficient combined bandwidth available reserved for 
protected paths and unprotected paths to accommodate the path; if the second search is not 
5 successful then, performing a third search for a path using only links having sufficient 
combined bandwidth available reserved for protection paths, protected paths and unprotected 
paths to accommodate the path and configuring appropriate nodes within the network in 
accordance with the path found. 

There is also provided in accordance with the present invention a method of path 

10 routing in a network, the method comprising the steps of receiving link state advertising 
information generated by nodes within the network, the link state advertising information 
utilized to derive the bandwidth available on a particular link for protection paths and non- 
protection paths, performing a first search for a path using only links having sufficient 
bandwidth available reserved for non-protection paths to accommodate the path; if the first 

15 search is not successful then, performing a second search for a path using only links having 
sufficient combined bandwidth available reserved for protection paths and non-protection 
paths to accommodate the path and configuring appropriate nodes within the network in 
accordance with the path found. 

There is further provided in accordance with the present invention a method of 

20 routing unprotected Label Switched Paths (LSPs) in a network, the method comprising the 
steps of receiving link state advertising information generated by nodes within the network, 
the link state advertising information utilized to derive the bandwidth available on a 
particular link for protection paths, protected paths and unprotected paths, performing a first 
search for a path using only links having sufficient available bandwidth for unprotected paths 

25 to accommodate the path; if the first search is not successful then, performing a second search 
for a path using only links having sufficient combined available bandwidth for protected 
paths and unprotected paths to accommodate the path; and if the second search is not 
successful then, performing a third search for a path using only links having sufficient 
combined available bandwidth for protection paths, protected paths and unprotected paths to 

30 accommodate the path. 

There is also provided in accordance with the present invention a method of routing 
protected Label Switched Paths (LSPs) in a network, the method comprising the steps of 
receiving link state advertising information generated by nodes within the network, the link 
state advertising information utilized to derive the bandwidth available on a particular link for 
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protection paths, protected paths and unprotected paths, perfonning a first search for a path 
using only links having sufficient available bandwidth for protected paths to accommodate 
the path; if the first search is not successful then, performing a second search for a path using 
only links having sufficient combined available bandwidth for protected paths and 
5 unprotected paths to accommodate the path; and if the second search is not successful then, 
performing a third search for a path using only links having sufficient combined available 
bandwidth for protection paths, protected paths and unprotected paths to accommodate the 
path. 

There is still further provided in accordance with the present invention a network 

10 device, comprising one or more line PHY line interfaces for interfacing the network device to 
one or more communication links, a switch adapted to switch data between a plurality of 
ingress inputs and a plurality of egress outputs, a processor, memory means coupled to the 
processor, software means operative on the processor for receiving link state advertising 
information generated by nodes within the network, the link state advertising information 

15 utilized to derive the bandwidth available on a particular link for protection paths, protected 
paths and unprotected paths, performing a first search for a path using only links having 
sufficient bandwidth available of a first type the same as that of the path to be found to 
accommodate the path; if the first search is not successful then, performing a second search 
for a path using only links having sufficient combined available bandwidth of a second type 

20 opposite of that of the path to be found to accommodate the path; and if the second search is 
not successful then, performing a third search for a path using only links having sufficient 
protection path bandwidth available to accommodate the path. 

There is also provided in accordance with the present invention a computer program 
product for use in a network device, the computer program product comprising a computer 

25 useable medium having computer readable program code means embodied in the medium for 
performing a path reroute in a network, the computer program product comprising computer 
readable program code means for advertising link state information utilized to derive the 
bandwidth available on a particular link for protection paths, protected paths and unprotected 
paths, computer readable program code means for performing a first search for a path using 

30 only Unks having sufficient bandwidth available of a type the same as that of the path to be 
found to acconamodate the path, computer readable program code means for performing a 
second search, if the first search is not successful, for a path using only links having sufficient 
combined bandwidth available reserved for protected paths and unprotected paths to 
accommodate the path and computer readable program code means for performing a third 
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search, if the second search is not successful, for a path using only links having sufficient 
combined bandwidth available reserved for protection paths, protected paths and unprotected 
paths to accommodate the path. 
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BRffiF DESCRIPTION OF THE DRAWINGS 
The invention is herein described, by way of example only, with reference to the 
accompanying drawings, wherein: 

Fig. 1 is a diagram illustrating an example MPLS based network incorporating a 
5 bypass tunnel; 

Fig. 2 is a diagram illustrating the protection tunnel available bandwidth TLV object 
in accordance with the present invention; 

Fig. 3 is a diagram illustrating the protected path available bandwidth TLV object in 
accordance with the present invention; 
10 Fig. 4 is a diagram illustrating the unprotected path available bandwidth TLV object 

in accordance with the present invention; 

Fig. 5 is a diagram illustrating the protection tunnel available bandwidth TLV object 
including a plurality of priority classes in accordance with the present invention; 

Fig. 6 is a diagram illustrating the protected path available bandwidth TLV object 
15 including a plurality of priority classes in accordance with the present invention; 

Fig. 7 is a diagram illustrating the unprotected path available bandwidth TLV object 
including a plurality of priority classes in accordance with the present invention; 

Fig. 8 is a flow diagram illustrating the path reroute mechanism of the present 
invention; and 

20 Fig. 9 is a block diagram illustrating an example network device such as a link 

switched router incorporating the path reroute mechanism of the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

Notation Used Throughout 
The following notation is used throughout this document. 



Term Definition 



ASIC 


Application Specific Integrated Circuit 


ATM 


Asynchronous Transfer Mode 


BGP 


Border Gateway Protocol 


CD-ROM 


Compact Disc-Read Only Memory 


CIR 


Committed Information Rate 


CPU 


Central Processing Unit 


CR-LDP 


Constraint-based Label Distribution Protocol 


DAT 


Digital Audio Tape 


DSP 


Digital Signal Processor 


DVD 


Digital Versatile Disk 


EEPROM 


Electrically Erasable Programmable Read Only Memory 


EEROM 


Electrically Erasable Read Only Memory 


EPROM 


Erasable Programmable Read Only Memory 


FDDI 


Fiber Distributed Data Interface 


ns 


Failure Indication Signal 


FPGA 


Field Programmable Gate Array 


FRS 


Fault Recovery Signal 


IP 


Internet Protocol 


ISIS 


Intermediate System to Intermediate System 


LAN 


Local Area Network 


LD 


Link Degraded 


LDP 


Label Distribution Protocol 


LP 


Link Failure 


LSP 


Label Switched Path 


LSR 


Label Switching Router 


MPLS 


Multi-Protocol Label Switching 


NIC 


Network Interface Card 


NMS 


Network Management System 


OSPF 


Open Shortest Path First 


OSPF-TE 


Open Shortest Path First with Traffic Engineering 


PG 


Path Grotip 


PML 


Path Merge LSR 


PNNI 


Private Network to Network Interface 


PPG 


Protected Path Group 


PSL 


Path Switch LSR 


PTP 


Protected Traffic Portion 


RAM 


Random Access Memory 


ROM 


Read Only Memory 


RSVP 


Reservation Protocol 


RSVP-TE 


Reservation Protocol with Traffic Engineering extensions 


SDH 


Synchronous Data Hierarchy 


SONET 


Synchronous Optical Network 


TLV 


Type, Length, Value object 
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Definitions Used Throughout 
The following terms and definitions apply throughout this document. 
Rerouting is defined as a procedure for changing the route of a traffic path. Rerouting 
can serve as a recovery mechanism in which the broken path, the recovery path or segments 
5 of these paths are created dynamically after the detection of a fault on the working path. In 
other words, rerouting can serve as a recovery mechanism in which the recovery path is not 
pre-established. Rerouting can also serve as an optimization mechanism in which path routes 
are dynamically changed to ones that are better suited for current network conditions. 

Protection switching is defined as a recovery mechanism in which the recovery path is 
10 created prior to the detection of a fault on the working path, path segment or network 
segment it protects. In other words, a recovery mechanism in which the recovery path is pre- 
established. 

Protection bandwidth is defined as bandwidth on a link reserved for protection 
purposes, e.g., protection tunnels, bypass turmels, recovery path, detour paths and protection 
15 paths. 

The working path is the protected path that carries traffic before the occurrence of a 

fault. The working path exists, in MPLS networks for example, between a PSL and PML. 

The working path can be of different kinds; a hop-by-hop routed path, a trunk, a link, an LSP, 

part of an LSP, a group of LSP parts or part of a multipoint-to-point LSP. The terms primary 
20 path and active path are synonyms for a working path. 

The recovery path is the path by which traffic is restored after the occurrence of a 

fault. In other words, the path on which the traffic is directed by the recovery mechanism. 

The recovery path may be established by MPLS means. The terms back-up path, alternative 

path and protection path are synonyms for a recovery path. 
25 The protection counterpart is the 'other' path when discussing pre-planned protection 

switching schemes. The protection counterpart for the working path is the recovery path and 

vice-versa. 

A path group (PG) is a logical bundling of multiple working paths, each of which is 
routed identically between a Path Switch LSR and a Path Merge LSR. A protected path 
30 group (PPG) is a path group that requires protection. A protected traffic portion (PTP) is the 
portion of the traffic on an individual path that requires protection. 

The path switch LSR (PSL) is an LSR responsible for switching or replicating the 
traffic between the working path and the recovery path. The path merge LSR (PML) is an 
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LSR that receives both working path traffic and its corresponding recovery path traffic, and 
either merges their traffic into a single outgoing path, or, if it is itself the destination, passes 
the traffic on to the higher layer protocols. 

An intermediate LSR is an LSR on a working or recovery path that is neither a PSL 
5 nor a PML for that path. A bypass tunnel is a path that serves to back up a set of working 
paths using the label stacking approach in MPLS. The working paths and the bypass tunnel 
must all share the same path switch LSR (PSL) and the path merge LSR (PML). 

A switchover is the process of switching the traffic from the path that the traffic is 
flowing on onto one or more alternate path(s). This may involve moving traffic from a 
10 working path onto one or more recovery paths, or may involve moving traffic from a 
recovery path(s) on to a more optimal working path(s). A switchback is the process of 
returning the traffic from one or more recovery paths back to the working path(s). 

Revertive mode refers to a recovery mode in which traffic is automatically switched 
back from the recovery path to the original working path upon the restoration of the working 
15 path to a fault-free condition. This assumes a failed working path does not automatically 
surrender resources to the network. Non-revertive mode refers to a recovery mode in which 
traffic is not automatically switched back to the original working path after this path is 
restored to a fault- condition. Note that depending on the configuration, the original working 
path may, upon movmg to a fault-free condition, become the recovery path, or it may be used 
20 for new working traffic, and be no longer associated with its original recovery path. 

MPLS protection domain refers to the set of LSRs over which a working path and its 
corresponding recovery path are routed. MPLS protection plan refers to the set of all LSP 
protection paths and the mapping from working to protection paths deployed in an MPLS 
protection domain at a given time. 
25 A liveness or keep alive message is a message exchanged periodically between two 

adjacent LSRs that serve as a link probing mechanism. It provides an integrity check of the 
forward and the backward directions of the link between the two LSRs as well as a check of 
neighbor aliveness. A path continuity test is a test that verifies the integrity and continuity of 
a path or path segment. 

30 A path failure (PF) is a fault detected by MPLS-based recovery mechanisms, which is 

defmed as the failure of the keep alive message test or a path continuity test, which indicates 
that path connectivity is lost. Path degraded is a fault detected by MPLS-based recovery 
mechanisms that indicates that the quality of the path is unacceptable. A link failure (LF) is a 
lower layer fauh indicating that link continuity is lost. This may be communicated to the 
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MPLS-based recovery mechanisms by the lower layer. Link degraded (LD) is a lower layer 
indication to MPLS-based recovery mechanisms that the link is performing below an 
acceptable level. 

A fault indication signal (FIS) is a signal that indicates that a fault along a path has 
5 occurred. It is relayed by each intermediate LSR to its upstream or downstream neighbor, 
until it reaches an LSR that is setup to perform MPLS recovery. The FIS is transmitted 
periodically by the node/nodes closest to the point of failure, for some configurable length of 
time. 

A fault recovery signal (FRS) is a signal that indicates a fault along a working path 
10 has been repaired. Again, like the FIS, it is relayed by each intermediate LSR to its upstream 

or downstream neighbor, until is reaches the LSR that performs recovery of the original path. 

The FRS is transmitted periodically by the node/nodes closest to the point of failure, for some 

configurable length of time. 

The term MPLS-based recovery refers to the ability to quickly and completely restore 
15 traffic lost due to a fault in an MPLS-network. The fault may be detected on the MPLS layer 

or in lower layers over which MPLS traffic is transported. The fastest MPLS recovery is 

typically achieved using protection switching. The MPLS LSR switchover time is 

comparable to the 50 ms switchover time of SONET. 

Detailed Description of the Invention 

20 The present invention provides a path reroute mechanism for use in communication 

networks. The mechanism comprises a muUistage search for a routing path to restore traffic 
following a failure that could not be protected by a previously established protection route 
(i.e. protection tunnel, bypass, etc.). The invention is applicable for use in any traffic 
engineering technique used to create connections in a network. The traffic engineering used 

25 must rely on some type of link state information advertising whereby the available 
bandwidths on each link is flooded throughout the network and used in making bandwidth 
calculations to insure that connections will provide previously agreed on Committed 
Information Rates (CIRs). The invention is not limited by the type of network in use, the 
type of routing used to select the reroutes or by the or signaling in use in the network. 

30 Examples of applicable networks include, but are not limited to, MPLS and Private Network 
to Network Interface (PNNI) based Asynchronous Transfer Mode (ATM) networks. 

For illustration purposes, the principles of the present invention are described in the 
context of an MPLS based network employing any suitable routing such as OSPF-TE and 
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signaling such as RSVP-TE signaling. Further, it is intended that the mechanism of the 
present invention is be implemented in the network devices such as routers (e.g., LSRs in 
MPLS networks) within the network. It is not intended, however, that the invention be 
limited to the configurations and embodiments described herein. It is appreciated that one 
5 skilled in the networking, electrical and/or software arts may apply the principles of the 
present invention to numerous other types of networking devices and network configurations 
as well without departing from the spirit and scope of the invention. 

As described supra, one type of protection scheme used in MPLS networks is based 
on providing protection tunnels for working links. In order that sufficient bandwidth be 

10 available for these protection channels, the links that protection tunnels traverse should not be 
allocated with more than a certain amount of CIR traffic. This ensures that enough 
bandwidth remains free for the use of these protection-tunnels when needed. 

Since protection tunnels do not provide protection against all types of failures (e.g., 
like arbitrary number of simultaneous faults, node failures, etc.), it is preferable that the 

15 RSVP-TE (or any other suitable signaling protocol) based rerouting mechanism be able to 
reroute LSPs that are currently routed through failed parts of the network. The rerouted paths 
should be established without using bandwidth originally reserved for protection purposes. 
In the event, however, that the reroute cannot be established otherwise, than bandwidth 
reserved for protection purposes is used. 

20 Thus, in accordance with the present invention, the path rerouting mechanism is such 

that the percentage of the bandwidth reserved for protection purposes is only used for 
rerouting CIR LSPs when no other type of bandwidth is available. This percentage of 
bandwidth saved for protection purposes is referred to as protection bandwidth. 

The path reroute mechanism comprises performing multiple searches for a route when 

25 a LSP is to be rerouted. Each search is performed on a larger and larger portion of the total 
available bandwidth of the link. In the example embodiment presented herein, three different 
bandwidth types are defined including: bandwidth reserved for protection purposes, 
bandwidth reserved for protected paths (i.e. protected LSPs) and bandwidth reserved for 
unprotected paths (i.e. unprotected LSPs). Thus, is the first attempt to find a route, only a 

30 portion of the available bandwidth of each link is considered. If no route is found, a second 
search is performed considering a larger portion of the available bandwidth and if a route is 
still nor found, a third search is performed considering 100% of the available bandwidth of 
the links. 
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Thus, in order for a node to be able to reroute a LSP, it must have knowledge about 
the availability of the different bandwidths on each link. This is achieved by having each 
node advertise the actual amount of bandwidth available on each link. Many routing 
protocols already include such a capability including, OSPF with traffic engineering 
5 extensions (OSPF-TE), ATM' s PNNI, etc. 

When needing to route or reroute an LSP, the LSP-initiating node first runs a routing 
search algorithm such as Dijkstra but only on the links in which the available bandwidth does 
not exceed the bandwidth allocated for user-LSPs when calculated after the LSP is rerouted 
to use that link. If this first search does not succeed, the LSP-initiating node runs Dijkstra a 
10 second time but considering the bandwidth reserved for protection purposes as well as that 
reserved for non-protection purposes. If the user-LSPs are subdivided into protected LSPs 
and unprotected LSPs, a three search process is performed. 

In addition, a background process in each node attempts to reroute LSPs that are not 
using an optimal path. This process will try to reroute LSPs that go through links in which 
15 the available bandwidth is less than the protection path bandwidth. 

In order that multiple nodes to not become synchronized in trying to reroute paths at 
the same time, an element of randomness is added in that the iterations of the rerouting 
process are not of constant duration. 

Note that the LSP initiating node (i.e. the node desiring to reroute a LSP) performs the 
20 multiple search mechanism of the present invention. Other network entities, however, may 
also perform the mechanism of the present invention providing they have the information 
necessary to execute the method of the invention. 

The mechanism of the present invention is adapted to take into account the existence 
of multiple traffic priority classes and the overbooking factor used by nodes in allocating 
25 bandwidth to LSPs. In many network implementations, the LSRs maintain a different 
overbooking factor for each priority class. Further, the overbooking factor is local to the LSR 
and is not necessarily known to the LSP initiating node. Thus, in accordance with the 
invention, the available bandwidth values advertised by each node already have factored into 
them the overbooking factor. Thus, the available bandwidth values used by the LSP initiating 
30 node in its route search accurately represent the amount of bandwidth available on that link. 

The path reroute mechanism of the present invention provides several per link TLVs 
(or sub-TLVs) to be advertised by the routing protocol (e.g., OSPF-TE), that comprise link 
bandwidth availability information available for new LSPs in each priority class. TLVs are 
provided for the three types of available bandwidth on a link: protection bandwidth, 
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bandwidth for protected LSPs and bandwidth for protected LSPs. As described supra, a few 
variations of the way this information can be provided, for example by taking advantage of 
the OSPF-TE TLV for link available bandwidth, by providing less information (e.g., not 
supporting non-protected LSP bandwidth information distribution) or by providing the value 
5 of different subsets of the bandwidth of the link. 

The structure of the various TLVs is described hereinbelow. Each link in the network 
is adapted to advertise at least three values: (1) the amount of protection bandwidth available 
which is the bandwidth available for protection purposes; (2) the amount of bandwidth 
available for protected LSPs, i.e. LSPs that are protected by a protection tunnel (or tunnels) 

10 on other links; and (3) the amount of bandwidth available for unprotected LSPs, i.e. LSPs that 
are not protected by any protection tunnels. As stated supra, several variations are possible, 
including using the link-bandwidth sub-TLV provided by the OSPF-TE protocol instead of 
one of these three TLVs as well as advertising less information. 

Allowing protected and unprotected LSPs to be established permits less than 50% of 

15 the bandwidth to be kept aside for protection tunnels. For example, 30% of the bandwidth 
may be reserved for protection tunnels, 30% for protected LSPs and 40% for unprotected 
LSPs. 

A diagram illustrating the protection tunnel available bandwidth TLV object in 
accordance with the present invention is shown in Figure 2. The TLV illustrated, generally 

20 referenced 20, is used to advertise the bandwidth available for protection tunnel purposes. 
The TLV comprises a unique type field 22 indicative of the contents of the TLV, a length 
field 24 indicating that the length of the value field is 4 bytes and the value 26 representing 
the bandwidth available for protection tunnels represented in a suitable format, e.g., 32 bit 
IEEE floating point format. Note that the value of this TLV object should not change when 

25 protection tunnels are routed through that link, but only when user-LSPs start using more 
than the bandwidth allocated for user-LSPs and start using the bandwidth that is reserved for 
protection purposes. Note also that alternatively, this TLV may be a sub-TLV of another 
TLV-object. 

A diagram illustrating the protected path available bandwidth TLV object in 
30 accordance with the present invention is shown in Figure 3. The TLV illustrated, generally 
referenced 30, is used to advertise the bandwidth available for estabUshment of protected 
LSPs. The TLV comprises a unique type field 32 indicative of the contents of the TLV, a 
length field 34 (4 bytes) and the value 36 representing the bandwidth available for protected 
LSPs represented in a suitable format, e.g., 32 bit IEEE floating point format. 
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A diagram illustrating the unprotected path available bandwidth TLV object in 
accordance with the present invention is shown in Figure 4. The TLV illustrated, generally 
referenced 40, is used to advertise the bandwidth available for establishment of unprotected 
LSPs. The TLV comprises a unique type field 42 indicative of the contents of the TLV, a 
5 length field 44 (4 bytes) and the value 46 representing the bandwidth available for 
unprotected LSPs represented in a suitable format, e.g., 32 bit IEEE floating point format. 

The invention also provides an additional three TLVs for use in networks with 
different priority classes. The example TLVs described infra include bandwidth values for 
eight priority classes. Alternatively, the TLVs can be modified to accommodate any number 
10 of priority classes or any other types of classes). 

A diagram illustrating the protection tunnel available bandwidth TLV object including 
a plurality of priority classes in accordance with the present invention is shown in Figure 5. 
The TLV illustrated, generally referenced 50, is used to advertise the bandwidth available for 
protection mnnel purposes for each of eight priority classes. The TLV comprises a unique 
15 type field 52 indicative of the contents of the TLV, a length field 54 indicating that the value 
length is 32 bytes and eight values 56 representing the bandwidth available for protection 
tunnels for each of eight priority classes, each represented in a suitable format, e.g., 32 bit 
IEEE floating point format. 

A diagram illustrating the protected path available bandwidth TLV object including a 
20 plurality of priority classes in accordance with the present invention is shown in Figure 6. 
The TLV illustrated, generally referenced 60, is used to advertise the bandwidth available for 
protected LSPs for each of eight priority classes. The TLV comprises a unique type field 62 
indicative of the contents of the TLV, a length field 64 (32 bytes) and eight values 66 
representing the bandwidth available for protected LSPs for each of eight priority classes, 
25 each represented in a suitable format, e.g., 32 bit IEEE floating point format. 

A diagram illustrating the unprotected path available bandwidth TLV object including 
a plurality of priority classes in accordance with the present invention is shown in Figure 7. 
The TLV illustrated, generally referenced 70, is used to advertise the bandwidth available for 
unprotected LSPs for each of eight priority classes. The TLV comprises a unique type field 
30 72 indicative of the contents of the TLV, a length field 74 (32 bytes) and eight values 76 
representing the bandwidth available for unprotected LSPs for each of eight priority classes, 
each represented in a suitable format, e.g., 32 bit IEEE floating point format. 

The path reroute mechanism of the present invention will now be described in more 
detail. A flow diagram illustrating the path reroute mechanism of the present invention is 
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shown in Figure 8. Each link in the network is adapted to advertise the bandwidth available 
on an optional per priority class basis for protection tunnels, protected LSPs and unprotected 
LSPs (step 80). Note that this step is performed by the nodes (e.g., LSRs) in the network for 
each of the links connected thereto. Note also that the values advertised for a link indicating 
5 the bandwidth available for protection tunnels, do not change when one of more protection 
tunnels are configured or rerouted to flow through the link. These values are altered 
accordingly when user-LSPs with CIR begin usmg this bandwidth because the bandwidth 
allocated for them within the link is exhausted. 

When a path (e.g., LSP) is to be rerouted for whatever reason, the LSP initiating node 

10 executes the routing algorithm only on the links with sufficient bandwidth available of the 
same type as that of the LSP to be routed (step 82). If the LSP to be routed is a protected 
LSP, then the first routing search is performed using links with sufficient available bandwidth 
for protected LSPs. Conversely, if the LSP to be routed is an unprotected LSP, then the first 
routing search is performed using links with sufficient available bandwidth for unprotected 

15 LSPs. Note that any suitable routing algorithm may be used, such as the well known Dijkstra 
algorithm. 

If a route was found (step 84), the LSP is established using the route found (step 96). 
If a route was not found, however, a second routing search is performed. In this second 
search, the LSP initiating node executes the routing algorithm considering the combined 
20 available bandwidths reserved for both protected and unprotected LSPs (step 86). The search 
algorithm only uses links having sufficient combined protected and unprotected bandwidth. 

If a route was found (step 88), the LSP is established using the route found (step 96). 
If a route was not found, however, a third routing search is performed. In this third search, 
the LSP initiating node executes the routing algorithm considering the combined available 
25 bandwidths reserved for protection tunnels, protected LSPs and unprotected LSPs (step 90). 
Only links with sufficient bandwidth available are used in the route search. Thus, if the route 
cannot be established using the combined available bandwidth reserved for protected and 
unprotected LSPs, the route is attempted using the protection tunnel bandwidth. 

If a route was found (step 92), the LSP is established using the route found and the 
30 bandwidth available in all three bandwidth allocation groups. If a route still cannot be found 
after the third search, a message such as 'Route not found' is returned. 

Note that, as described supra, the routing algorithm may comprise only two searches 
such as in the event protected and unprotected LSP bandwidth are combined within a single 
bandwidth allocation for non-protection purposes. In this case, when needing to route or 
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reroute an LSP, the LSP-initiating node first performs the search algorithm on the links in 
which the available bandwidth exceeds the CIR requirement of user LSP. If this first search 
fails, a second search is performed considering the bandwidth reserved for protection 
purposes as well as that reserved for non-protection purposes. 
5 In accordance with the invention, the rerouting algorithm of the present invention is 

applicable in various cases. One is when a failure or a series of failures is not completely 
covered by the fast protection mechanism and rerouting is performed in order to fix the LSPs 
broken due to these failures. A second case is when there is a need to optimize LSPs after a 
failure, since the fast protection mechanism route packets over non-optimized paths. A third 
10 case is in optimizing rerouting after a topology change (e.g., link or node recovery) or as part 
of a periodic optimization process. When rerouting a working-LSP, such as in the last two 
cases, the rerouting should not be put into place if the new calculated LSP uses bandwidth 
allocated for protection tunnels in all or part of its links, while the existing LSP does not. 
One possible scheme is to prefer the route in which less links are over occupied. 

15 Network Device/LSR Embodiment 

An example network device is operative to execute software adapted to perform the 
path rerouting mechanism of the present invention or any portion thereof. Hardware and 
software means adapted to execute the mechanism may be incorporated within a network 
device such as a Network Management System, Label Switching Router (LSR) or any other 

20 wired or wireless network device. The device may be constructed using any combination of 
hardware and/or software. 

A block diagram illustrating an example network device such as a link switched 
router incorporating the path reroute mechanism of the present invention is shown in Figure 
9. The network device, generally referenced 100, comprises a processor 108 which may be 

25 implemented as a microcontroller, microprocessor, microcomputer, ASIC core, FPGA core, 
central processing unit (CPU) or digital signal processor (DSP). The system further 
comprises non volatile memory including EEPROM 110 for storing configuration and 
network related parameters. Flash memory 112 for storing program code and configuration 
parameters and dynamic main memory (e.g., RAM) 114 all in communication with the 

30 processor. The processor is also in communication, via a bus 106, with a number of 
peripheral devices that are also included in the computer system. A single modular LSR may 
be built of a number of modules (e.g., cards), each containing part of the switching fabric and 
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a number of line interfaces. Each such module may contain a CPU subsystem of its own, 
including CPU and volatile as well as non-volatile memory. 

The network device comprises a NIC 116 for providing an out of band interface 118 
for connecting to external entities such as a craft for local maintenance and configuration 
5 purposes, a NMS for centralized administration and control or a Local Area Network (LAN). 
The device may comprise additional interfaces, such as a serial interface for connecting to a 
PC for configuration purposes. The network device also comprises a switching core 120, 
which is adapted to perform the switching function of the network device. The switch may 
comprise, for example, hardware for performing MPLS switching, hardware for performing 

10 Frame Relay switching or hardware for performing ATM switching. 

One or more line interface cards 122, 124 provide the PHY interface to two way 
communication links 102, 104. As an example, the interface cards may be adapted to 
interface to any combination of the following communication links: any variety of copper or 
optical based Ethernet, Token Ring, FDDI, SONET/SDH, ATM. 

15 The network device also comprises an optional user interface adapted to respond to 

user inputs and provide feedback and other status information. A host interface enabled 
communication with a host computing device. The host may be adapted to configure, control 
and maintain the operation of the device. The device may also comprise magnetic storage 
device means for storing application programs and data. 

20 The network device comprises computer readable storage medium which may include 

any suitable memory means including but not limited to magnetic storage, optical storage, 
CD-ROM drive, ZIP drive, DVD drive, DAT cassette, semiconductor based volatile or non- 
volatile memory, biological memory devices, or any other memory storage device. 

Software operative to implement the functionality of the path reroute mechanism of 

25 the present invention is adapted to reside on a computer readable medium, such as a magnetic 
disk within a disk drive unit or any other volatile or nonvolatile memory. Alternatively, the 
computer readable medium may comprise a floppy disk, Hash memory, EPROM, EEROM, 
EEPROM based memory, bubble memory storage, ROM storage, etc. The software adapted 
to perform the path reroute mechanism of the present invention or any portion thereof may 

30 also reside, in whole or in part, in the static or dynamic main memories or in firmware within 
the processor of the network device (i.e. within microcontroller, microprocessor, 
microcomputer, DSP, etc. internal memory). 

In alternative embodiments, the method of the present invention may be applicable to 
implementations of the invention in integrated circuits, field programmable gate arrays 
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(FPGAs), chip sets or application specific integrated circuits (ASICs), DSP circuits, wireless 
implementations and other communication system products. 

It is intended that the appended claims cover all such features and advantages of the 
invention that fall within the spirit and scope of the present invention. As numerous 
modifications and changes will readily occur to those skilled in the art, it is intended that the 
invention not be limited to the limited number of embodiments described herein. 
Accordingly, it will be appreciated that all suitable variations, modifications and equivalents 
may be resorted to, falling within the spirit and scope of the present invention. 
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